2023-09-28 08:52:22,264 gpu device = 0
2023-09-28 08:52:22,264 args = Namespace(adaptive=True, batch_size=64, constraint=1000, cutout=False, data='./data', gpu=0, gumbel=True, init_alphas=0, init_channels=16, layers=9, nasbench_data='nasbench_full.tfrecord', output_weights=True, penalty=1, rand_data=False, rand_label=False, report_freq=10, save='search_NASI/nasbench-S1', search_space='1', seed=1, steps=40)
2023-09-28 08:52:24,512 param size = 1.101402MB
2023-09-28 08:52:25,474 loading data from nasbench
2023-09-28 08:52:25,475 From /home/xxxx/NAS-NGE/nasbench/api.py:146: tf_record_iterator (from tensorflow.python.lib.io.tf_record) is deprecated and will be removed in a future version.
Instructions for updating:
Use eager execution and: 
`tf.data.TFRecordDataset(path)`
2023-09-28 08:54:38,418 start search
2023-09-28 08:54:40,006 Train 000, penalty loss 214.541122
2023-09-28 08:54:40,007 Constraint: 1000.000000
2023-09-28 08:54:40,010 TEST ERROR: 0.134, 0.145, 0.133 | VALID ERROR: 0.129, 0.140, 0.127 | RUNTIME: 934.287964, 941.374023, 938.169983 | PARAMS: 1143306, 1143306, 1143306
2023-09-28 08:54:47,323 Train 010, penalty loss 211.145401
2023-09-28 08:54:47,324 Constraint: 321.695004
2023-09-28 08:54:47,326 TEST ERROR: 0.084, 0.086, 0.088 | VALID ERROR: 0.075, 0.081, 0.084 | RUNTIME: 1199.679932, 1195.896973, 1200.508057 | PARAMS: 3905290, 3905290, 3905290
2023-09-28 08:54:54,568 Train 020, penalty loss 46.423985
2023-09-28 08:54:54,568 Constraint: 238.528641
2023-09-28 08:54:54,569 TEST ERROR: 0.084, 0.086, 0.088 | VALID ERROR: 0.075, 0.081, 0.084 | RUNTIME: 1199.679932, 1195.896973, 1200.508057 | PARAMS: 3905290, 3905290, 3905290
2023-09-28 08:55:01,878 Train 030, penalty loss 228.973938
2023-09-28 08:55:01,879 Constraint: 228.973951
2023-09-28 08:55:01,881 TEST ERROR: 0.065, 0.068, 0.067 | VALID ERROR: 0.061, 0.061, 0.059 | RUNTIME: 1303.167969, 1303.596924, 1301.520996 | PARAMS: 6230410, 6230410, 6230410
2023-09-28 08:55:08,661 final evaluation
2023-09-28 08:55:08,665 TEST ERROR: 0.067, 0.067, 0.068 | VALID ERROR: 0.064, 0.062, 0.062 | RUNTIME: 1372.609009, 1375.455078, 1374.968994 | PARAMS: 5969674, 5969674, 5969674
2023-09-28 09:07:27,700 gpu device = 0
2023-09-28 09:07:27,701 args = Namespace(adaptive=True, batch_size=64, constraint=1000, cutout=False, data='./data', gpu=0, gumbel=True, init_alphas=0, init_channels=16, layers=9, nasbench_data='nasbench_full.tfrecord', output_weights=True, penalty=1, rand_data=False, rand_label=False, report_freq=10, save='search_NASI/nasbench-S1', search_space='2', seed=1, steps=40)
2023-09-28 09:07:29,984 param size = 1.101402MB
2023-09-28 09:07:30,963 loading data from nasbench
2023-09-28 09:07:30,963 From /home/xxxx/NAS-NGE/nasbench/api.py:146: tf_record_iterator (from tensorflow.python.lib.io.tf_record) is deprecated and will be removed in a future version.
Instructions for updating:
Use eager execution and: 
`tf.data.TFRecordDataset(path)`
2023-09-28 09:09:43,893 start search
2023-09-28 09:09:45,495 Train 000, penalty loss 1000.000000
2023-09-28 09:09:45,496 Constraint: 1000.000000
2023-09-28 09:09:45,500 TEST ERROR: 0.900, 0.900, 0.195 | VALID ERROR: 0.905, 0.905, 0.193 | RUNTIME: 833.464966, 834.455994, 833.497986 | PARAMS: 301074, 301074, 301074
2023-09-28 09:09:52,981 Train 010, penalty loss 54.702614
2023-09-28 09:09:52,982 Constraint: 322.098993
2023-09-28 09:09:52,985 TEST ERROR: 0.070, 0.072, 0.068 | VALID ERROR: 0.068, 0.064, 0.066 | RUNTIME: 1263.140015, 1268.338013, 1266.536011 | PARAMS: 2546711, 2546711, 2546711
2023-09-28 09:10:00,495 Train 020, penalty loss 136.974442
2023-09-28 09:10:00,496 Constraint: 325.545607
2023-09-28 09:10:00,499 TEST ERROR: 0.076, 0.072, 0.076 | VALID ERROR: 0.067, 0.070, 0.069 | RUNTIME: 1119.023926, 1114.617920, 1113.958008 | PARAMS: 2256801, 2256801, 2256801
2023-09-28 09:10:07,967 Train 030, penalty loss 277.798828
2023-09-28 09:10:07,968 Constraint: 277.798840
2023-09-28 09:10:07,971 TEST ERROR: 0.069, 0.066, 0.068 | VALID ERROR: 0.061, 0.062, 0.064 | RUNTIME: 1238.937012, 1238.001953, 1239.821045 | PARAMS: 3166137, 3166137, 3166137
2023-09-28 09:10:14,801 final evaluation
2023-09-28 09:10:14,806 TEST ERROR: 0.076, 0.072, 0.076 | VALID ERROR: 0.067, 0.070, 0.069 | RUNTIME: 1119.023926, 1114.617920, 1113.958008 | PARAMS: 2256801, 2256801, 2256801
2023-09-28 09:22:37,833 gpu device = 0
2023-09-28 09:22:37,833 args = Namespace(adaptive=True, batch_size=64, constraint=1000, cutout=False, data='./data', gpu=0, gumbel=True, init_alphas=0, init_channels=16, layers=9, nasbench_data='nasbench_full.tfrecord', output_weights=True, penalty=1, rand_data=False, rand_label=False, report_freq=10, save='search_NASI/nasbench-S1', search_space='3', seed=1, steps=40)
2023-09-28 09:22:40,118 param size = 1.509594MB
2023-09-28 09:22:41,079 loading data from nasbench
2023-09-28 09:22:41,080 From /home/xxxx/NAS-NGE/nasbench/api.py:146: tf_record_iterator (from tensorflow.python.lib.io.tf_record) is deprecated and will be removed in a future version.
Instructions for updating:
Use eager execution and: 
`tf.data.TFRecordDataset(path)`
2023-09-28 09:24:53,736 start search
2023-09-28 09:24:55,546 Train 000, penalty loss 447.548523
2023-09-28 09:24:55,546 Constraint: 1000.000000
2023-09-28 09:24:55,549 TEST ERROR: 0.069, 0.068, 0.070 | VALID ERROR: 0.063, 0.062, 0.063 | RUNTIME: 2470.680176, 2468.780029, 2473.475098 | PARAMS: 21384074, 21384074, 21384074
2023-09-28 09:25:04,754 Train 010, penalty loss 123.819962
2023-09-28 09:25:04,754 Constraint: 557.056017
2023-09-28 09:25:04,756 TEST ERROR: 0.076, 0.074, 0.072 | VALID ERROR: 0.073, 0.067, 0.066 | RUNTIME: 1157.626953, 1156.379028, 1157.510986 | PARAMS: 7421066, 7421066, 7421066
2023-09-28 09:25:13,978 Train 020, penalty loss 360.289215
2023-09-28 09:25:13,979 Constraint: 480.563594
2023-09-28 09:25:13,981 TEST ERROR: 0.088, 0.082, 0.084 | VALID ERROR: 0.084, 0.074, 0.077 | RUNTIME: 781.718994, 781.291016, 785.104004 | PARAMS: 3292298, 3292298, 3292298
2023-09-28 09:25:23,261 Train 030, penalty loss 356.654053
2023-09-28 09:25:23,261 Constraint: 463.789468
2023-09-28 09:25:23,263 TEST ERROR: 0.082, 0.078, 0.081 | VALID ERROR: 0.073, 0.077, 0.073 | RUNTIME: 666.401978, 667.278015, 669.222046 | PARAMS: 3031562, 3031562, 3031562
2023-09-28 09:25:31,730 final evaluation
2023-09-28 09:25:31,736 TEST ERROR: 0.091, 0.107, 0.096 | VALID ERROR: 0.083, 0.099, 0.090 | RUNTIME: 1301.041992, 1298.337036, 1300.880005 | PARAMS: 7681802, 7681802, 7681802
