2023-09-28 08:07:41,707 gpu device = 0
2023-09-28 08:07:41,707 args = Namespace(adaptive=True, batch_size=64, constraint=1000, cutout=False, data='./data', gpu=0, gumbel=True, init_alphas=0, init_channels=16, layers=9, nasbench_data='nasbench_full.tfrecord', output_weights=True, penalty=1, rand_data=False, rand_label=False, report_freq=10, save='search_NAS-NOM/nasbench-S1', search_space='1', seed=1, steps=20)
2023-09-28 08:07:44,017 param size = 1.101402MB
2023-09-28 08:07:45,198 loading data from nasbench
2023-09-28 08:07:45,199 From /home/xxxx/NAS-NGE/nasbench/api.py:146: tf_record_iterator (from tensorflow.python.lib.io.tf_record) is deprecated and will be removed in a future version.
Instructions for updating:
Use eager execution and: 
`tf.data.TFRecordDataset(path)`
2023-09-28 08:09:57,901 start search
2023-09-28 08:10:00,072 Train 000, penalty loss -2.022386
2023-09-28 08:10:00,072 Constraint: 1000.000000
2023-09-28 08:10:00,077 TEST ERROR: 0.130, 0.126, 0.127 | VALID ERROR: 0.119, 0.124, 0.122 | RUNTIME: 1145.532959, 1146.637939, 1144.789062 | PARAMS: 1319434, 1319434, 1319434
2023-09-28 08:10:12,075 Train 010, penalty loss -3.224127
2023-09-28 08:10:12,077 Constraint: 204.411943
2023-09-28 08:10:12,080 TEST ERROR: 0.089, 0.096, 0.092 | VALID ERROR: 0.084, 0.087, 0.084 | RUNTIME: 1253.095947, 1255.145020, 1254.224976 | PARAMS: 3644554, 3644554, 3644554
2023-09-28 08:10:23,162 final evaluation
2023-09-28 08:10:23,167 TEST ERROR: 0.088, 0.091, 0.098 | VALID ERROR: 0.084, 0.084, 0.097 | RUNTIME: 1179.937988, 1178.822021, 1178.117920 | PARAMS: 3905290, 3905290, 3905290
2023-09-28 08:22:14,516 gpu device = 0
2023-09-28 08:22:14,516 args = Namespace(adaptive=True, batch_size=64, constraint=1000, cutout=False, data='./data', gpu=0, gumbel=True, init_alphas=0, init_channels=16, layers=9, nasbench_data='nasbench_full.tfrecord', output_weights=True, penalty=1, rand_data=False, rand_label=False, report_freq=10, save='search_NAS-NOM/nasbench-S1', search_space='2', seed=1, steps=20)
2023-09-28 08:22:16,796 param size = 1.101402MB
2023-09-28 08:22:17,956 loading data from nasbench
2023-09-28 08:22:17,957 From /home/xxxx/NAS-NGE/nasbench/api.py:146: tf_record_iterator (from tensorflow.python.lib.io.tf_record) is deprecated and will be removed in a future version.
Instructions for updating:
Use eager execution and: 
`tf.data.TFRecordDataset(path)`
2023-09-28 08:24:30,791 start search
2023-09-28 08:24:32,951 Train 000, penalty loss -3.449785
2023-09-28 08:24:32,951 Constraint: 1000.000000
2023-09-28 08:24:32,954 TEST ERROR: 0.074, 0.074, 0.075 | VALID ERROR: 0.067, 0.069, 0.067 | RUNTIME: 1301.566895, 1302.731934, 1302.501953 | PARAMS: 2439677, 2439677, 2439677
2023-09-28 08:24:45,613 Train 010, penalty loss -2.962098
2023-09-28 08:24:45,615 Constraint: 237.350197
2023-09-28 08:24:45,617 TEST ERROR: 0.101, 0.104, 0.105 | VALID ERROR: 0.100, 0.104, 0.095 | RUNTIME: 939.803955, 941.926025, 940.579956 | PARAMS: 1617445, 1617445, 1617445
2023-09-28 08:24:57,063 final evaluation
2023-09-28 08:24:57,068 TEST ERROR: 0.094, 0.095, 0.095 | VALID ERROR: 0.092, 0.087, 0.092 | RUNTIME: 1169.117920, 1171.707031, 1170.063965 | PARAMS: 2025770, 2025770, 2025770
2023-09-28 08:36:54,963 gpu device = 0
2023-09-28 08:36:54,963 args = Namespace(adaptive=True, batch_size=64, constraint=1000, cutout=False, data='./data', gpu=0, gumbel=True, init_alphas=0, init_channels=16, layers=9, nasbench_data='nasbench_full.tfrecord', output_weights=True, penalty=1, rand_data=False, rand_label=False, report_freq=10, save='search_NAS-NOM/nasbench-S1', search_space='3', seed=1, steps=20)
2023-09-28 08:36:57,264 param size = 1.509594MB
2023-09-28 08:36:58,483 loading data from nasbench
2023-09-28 08:36:58,483 From /home/xxxx/NAS-NGE/nasbench/api.py:146: tf_record_iterator (from tensorflow.python.lib.io.tf_record) is deprecated and will be removed in a future version.
Instructions for updating:
Use eager execution and: 
`tf.data.TFRecordDataset(path)`
2023-09-28 08:39:13,635 start search
2023-09-28 08:39:16,210 Train 000, penalty loss -2.334995
2023-09-28 08:39:16,211 Constraint: 1000.000000
2023-09-28 08:39:16,215 TEST ERROR: 0.062, 0.070, 0.062 | VALID ERROR: 0.057, 0.062, 0.059 | RUNTIME: 2713.673096, 2711.541016, 2711.194092 | PARAMS: 22257802, 22257802, 22257802
2023-09-28 08:39:32,205 Train 010, penalty loss -1.719970
2023-09-28 08:39:32,207 Constraint: 393.038000
2023-09-28 08:39:32,210 TEST ERROR: 0.073, 0.070, 0.075 | VALID ERROR: 0.066, 0.064, 0.071 | RUNTIME: 1346.510986, 1347.933105, 1349.578979 | PARAMS: 5969674, 5969674, 5969674
2023-09-28 08:39:46,641 final evaluation
2023-09-28 08:39:46,644 TEST ERROR: 0.064, 0.064, 0.064 | VALID ERROR: 0.059, 0.061, 0.062 | RUNTIME: 1310.583008, 1310.575928, 1310.211914 | PARAMS: 7857930, 7857930, 7857930
