2023-09-28 08:10:34,701 gpu device = 0
2023-09-28 08:10:34,701 args = Namespace(adaptive=True, batch_size=64, constraint=1000, cutout=False, data='./data', gpu=0, gumbel=True, init_alphas=0, init_channels=16, layers=9, nasbench_data='nasbench_full.tfrecord', output_weights=True, penalty=1, rand_data=False, rand_label=False, report_freq=10, save='search_NAS-NOM/nasbench-S2', search_space='1', seed=2, steps=20)
2023-09-28 08:10:36,934 param size = 1.101402MB
2023-09-28 08:10:38,078 loading data from nasbench
2023-09-28 08:10:38,079 From /home/xxxx/NAS-NGE/nasbench/api.py:146: tf_record_iterator (from tensorflow.python.lib.io.tf_record) is deprecated and will be removed in a future version.
Instructions for updating:
Use eager execution and: 
`tf.data.TFRecordDataset(path)`
2023-09-28 08:12:54,598 start search
2023-09-28 08:12:56,869 Train 000, penalty loss -1.607275
2023-09-28 08:12:56,869 Constraint: 1000.000000
2023-09-28 08:12:56,874 TEST ERROR: 0.064, 0.065, 0.073 | VALID ERROR: 0.059, 0.059, 0.066 | RUNTIME: 2762.353027, 2763.239990, 2762.893066 | PARAMS: 16785290, 16785290, 16785290
2023-09-28 08:13:08,944 Train 010, penalty loss -1.551128
2023-09-28 08:13:08,945 Constraint: 233.867585
2023-09-28 08:13:08,946 TEST ERROR: 0.116, 0.110, 0.111 | VALID ERROR: 0.117, 0.107, 0.105 | RUNTIME: 944.174988, 945.511963, 946.104980 | PARAMS: 1756298, 1756298, 1756298
2023-09-28 08:13:20,002 final evaluation
2023-09-28 08:13:20,006 TEST ERROR: 0.068, 0.067, 0.067 | VALID ERROR: 0.062, 0.062, 0.059 | RUNTIME: 1386.105957, 1387.382080, 1391.302002 | PARAMS: 11051402, 11051402, 11051402
2023-09-28 08:25:08,397 gpu device = 0
2023-09-28 08:25:08,397 args = Namespace(adaptive=True, batch_size=64, constraint=1000, cutout=False, data='./data', gpu=0, gumbel=True, init_alphas=0, init_channels=16, layers=9, nasbench_data='nasbench_full.tfrecord', output_weights=True, penalty=1, rand_data=False, rand_label=False, report_freq=10, save='search_NAS-NOM/nasbench-S2', search_space='2', seed=2, steps=20)
2023-09-28 08:25:10,656 param size = 1.101402MB
2023-09-28 08:25:11,791 loading data from nasbench
2023-09-28 08:25:11,792 From /home/xxxx/NAS-NGE/nasbench/api.py:146: tf_record_iterator (from tensorflow.python.lib.io.tf_record) is deprecated and will be removed in a future version.
Instructions for updating:
Use eager execution and: 
`tf.data.TFRecordDataset(path)`
2023-09-28 08:27:21,065 start search
2023-09-28 08:27:23,329 Train 000, penalty loss -1.725789
2023-09-28 08:27:23,329 Constraint: 1000.000000
2023-09-28 08:27:23,332 TEST ERROR: 0.071, 0.072, 0.076 | VALID ERROR: 0.067, 0.061, 0.067 | RUNTIME: 1741.021973, 1741.586914, 1746.125000 | PARAMS: 4602890, 4602890, 4602890
2023-09-28 08:27:35,778 Train 010, penalty loss -3.196723
2023-09-28 08:27:35,780 Constraint: 684.652430
2023-09-28 08:27:35,782 TEST ERROR: 0.069, 0.067, 0.066 | VALID ERROR: 0.062, 0.063, 0.060 | RUNTIME: 1397.793945, 1398.021973, 1395.376953 | PARAMS: 4101315, 4101315, 4101315
2023-09-28 08:27:47,072 final evaluation
2023-09-28 08:27:47,077 TEST ERROR: 0.067, 0.064, 0.066 | VALID ERROR: 0.060, 0.059, 0.061 | RUNTIME: 1284.782959, 1282.838989, 1286.406006 | PARAMS: 3984576, 3984576, 3984576
2023-09-28 08:39:58,206 gpu device = 0
2023-09-28 08:39:58,206 args = Namespace(adaptive=True, batch_size=64, constraint=1000, cutout=False, data='./data', gpu=0, gumbel=True, init_alphas=0, init_channels=16, layers=9, nasbench_data='nasbench_full.tfrecord', output_weights=True, penalty=1, rand_data=False, rand_label=False, report_freq=10, save='search_NAS-NOM/nasbench-S2', search_space='3', seed=2, steps=20)
2023-09-28 08:40:00,513 param size = 1.509594MB
2023-09-28 08:40:01,698 loading data from nasbench
2023-09-28 08:40:01,699 From /home/xxxx/NAS-NGE/nasbench/api.py:146: tf_record_iterator (from tensorflow.python.lib.io.tf_record) is deprecated and will be removed in a future version.
Instructions for updating:
Use eager execution and: 
`tf.data.TFRecordDataset(path)`
2023-09-28 08:42:14,173 start search
2023-09-28 08:42:16,785 Train 000, penalty loss -1.964253
2023-09-28 08:42:16,786 Constraint: 1000.000000
2023-09-28 08:42:16,791 TEST ERROR: 0.123, 0.110, 0.120 | VALID ERROR: 0.117, 0.110, 0.119 | RUNTIME: 921.270996, 926.528992, 927.478027 | PARAMS: 1143306, 1143306, 1143306
2023-09-28 08:42:32,354 Train 010, penalty loss -2.195668
2023-09-28 08:42:32,356 Constraint: 263.664785
2023-09-28 08:42:32,360 TEST ERROR: 0.079, 0.077, 0.082 | VALID ERROR: 0.073, 0.071, 0.075 | RUNTIME: 1301.072021, 1299.876953, 1301.004028 | PARAMS: 6054282, 6054282, 6054282
2023-09-28 08:42:46,481 final evaluation
2023-09-28 08:42:46,486 TEST ERROR: 0.059, 0.064, 0.066 | VALID ERROR: 0.056, 0.056, 0.058 | RUNTIME: 3669.858887, 3668.545898, 3671.999023 | PARAMS: 31552906, 31552906, 31552906
