2023-09-28 08:04:47,177 gpu device = 0
2023-09-28 08:04:47,177 args = Namespace(adaptive=True, batch_size=64, constraint=1000, cutout=False, data='./data', gpu=0, gumbel=True, init_alphas=0, init_channels=16, layers=9, nasbench_data='nasbench_full.tfrecord', output_weights=True, penalty=1, rand_data=False, rand_label=False, report_freq=10, save='search_NAS-NOM/nasbench-S0', search_space='1', seed=0, steps=20)
2023-09-28 08:04:49,460 param size = 1.101402MB
2023-09-28 08:04:50,600 loading data from nasbench
2023-09-28 08:04:50,601 From /home/xxxx/NAS-NGE/nasbench/api.py:146: tf_record_iterator (from tensorflow.python.lib.io.tf_record) is deprecated and will be removed in a future version.
Instructions for updating:
Use eager execution and: 
`tf.data.TFRecordDataset(path)`
2023-09-28 08:07:03,676 start search
2023-09-28 08:07:05,926 Train 000, penalty loss -3.352403
2023-09-28 08:07:05,927 Constraint: 1000.000000
2023-09-28 08:07:05,931 TEST ERROR: 0.112, 0.114, 0.123 | VALID ERROR: 0.107, 0.105, 0.119 | RUNTIME: 1390.314941, 1389.921997, 1388.597900 | PARAMS: 3667594, 3667594, 3667594
2023-09-28 08:07:18,593 Train 010, penalty loss -1.618591
2023-09-28 08:07:18,594 Constraint: 209.139971
2023-09-28 08:07:18,596 TEST ERROR: 0.102, 0.101, 0.099 | VALID ERROR: 0.097, 0.094, 0.093 | RUNTIME: 1254.872070, 1255.817993, 1255.325928 | PARAMS: 3644554, 3644554, 3644554
2023-09-28 08:07:30,146 final evaluation
2023-09-28 08:07:30,148 TEST ERROR: 0.078, 0.083, 0.090 | VALID ERROR: 0.070, 0.077, 0.087 | RUNTIME: 2044.232910, 2047.042969, 2045.821045 | PARAMS: 11925130, 11925130, 11925130
2023-09-28 08:19:19,616 gpu device = 0
2023-09-28 08:19:19,616 args = Namespace(adaptive=True, batch_size=64, constraint=1000, cutout=False, data='./data', gpu=0, gumbel=True, init_alphas=0, init_channels=16, layers=9, nasbench_data='nasbench_full.tfrecord', output_weights=True, penalty=1, rand_data=False, rand_label=False, report_freq=10, save='search_NAS-NOM/nasbench-S0', search_space='2', seed=0, steps=20)
2023-09-28 08:19:21,888 param size = 1.101402MB
2023-09-28 08:19:23,054 loading data from nasbench
2023-09-28 08:19:23,054 From /home/xxxx/NAS-NGE/nasbench/api.py:146: tf_record_iterator (from tensorflow.python.lib.io.tf_record) is deprecated and will be removed in a future version.
Instructions for updating:
Use eager execution and: 
`tf.data.TFRecordDataset(path)`
2023-09-28 08:21:37,346 start search
2023-09-28 08:21:39,609 Train 000, penalty loss -1.747094
2023-09-28 08:21:39,610 Constraint: 1000.000000
2023-09-28 08:21:39,613 TEST ERROR: 0.103, 0.097, 0.098 | VALID ERROR: 0.097, 0.094, 0.091 | RUNTIME: 883.328979, 884.323975, 882.568970 | PARAMS: 1442598, 1442598, 1442598
2023-09-28 08:21:51,998 Train 010, penalty loss -3.126044
2023-09-28 08:21:52,000 Constraint: 512.780227
2023-09-28 08:21:52,003 TEST ERROR: 0.072, 0.082, 0.079 | VALID ERROR: 0.067, 0.074, 0.073 | RUNTIME: 2225.951904, 2226.062012, 2225.444824 | PARAMS: 5969674, 5969674, 5969674
2023-09-28 08:22:03,077 final evaluation
2023-09-28 08:22:03,082 TEST ERROR: 0.090, 0.080, 0.085 | VALID ERROR: 0.080, 0.077, 0.083 | RUNTIME: 2083.748047, 2082.384033, 2082.204102 | PARAMS: 4342154, 4342154, 4342154
2023-09-28 08:33:56,784 gpu device = 0
2023-09-28 08:33:56,785 args = Namespace(adaptive=True, batch_size=64, constraint=1000, cutout=False, data='./data', gpu=0, gumbel=True, init_alphas=0, init_channels=16, layers=9, nasbench_data='nasbench_full.tfrecord', output_weights=True, penalty=1, rand_data=False, rand_label=False, report_freq=10, save='search_NAS-NOM/nasbench-S0', search_space='3', seed=0, steps=20)
2023-09-28 08:33:59,059 param size = 1.509594MB
2023-09-28 08:34:00,253 loading data from nasbench
2023-09-28 08:34:00,253 From /home/xxxx/NAS-NGE/nasbench/api.py:146: tf_record_iterator (from tensorflow.python.lib.io.tf_record) is deprecated and will be removed in a future version.
Instructions for updating:
Use eager execution and: 
`tf.data.TFRecordDataset(path)`
2023-09-28 08:36:12,703 start search
2023-09-28 08:36:15,248 Train 000, penalty loss -2.053802
2023-09-28 08:36:15,249 Constraint: 1000.000000
2023-09-28 08:36:15,253 TEST ERROR: 0.122, 0.111, 0.112 | VALID ERROR: 0.111, 0.104, 0.104 | RUNTIME: 1038.432007, 1042.057983, 1038.406006 | PARAMS: 3031562, 3031562, 3031562
2023-09-28 08:36:30,354 Train 010, penalty loss -1.570964
2023-09-28 08:36:30,356 Constraint: 236.709273
2023-09-28 08:36:30,359 TEST ERROR: 0.089, 0.083, 0.092 | VALID ERROR: 0.085, 0.079, 0.088 | RUNTIME: 1230.203979, 1228.322021, 1227.712036 | PARAMS: 5532810, 5532810, 5532810
2023-09-28 08:36:43,377 final evaluation
2023-09-28 08:36:43,379 TEST ERROR: 0.089, 0.083, 0.092 | VALID ERROR: 0.085, 0.079, 0.088 | RUNTIME: 1230.203979, 1228.322021, 1227.712036 | PARAMS: 5532810, 5532810, 5532810
