2023-09-28 08:49:22,381 gpu device = 0
2023-09-28 08:49:22,381 args = Namespace(adaptive=True, batch_size=64, constraint=1000, cutout=False, data='./data', gpu=0, gumbel=True, init_alphas=0, init_channels=16, layers=9, nasbench_data='nasbench_full.tfrecord', output_weights=True, penalty=1, rand_data=False, rand_label=False, report_freq=10, save='search_NASI/nasbench-S0', search_space='1', seed=0, steps=40)
2023-09-28 08:49:24,672 param size = 1.101402MB
2023-09-28 08:49:25,653 loading data from nasbench
2023-09-28 08:49:25,654 From /home/xxxx/NAS-NGE/nasbench/api.py:146: tf_record_iterator (from tensorflow.python.lib.io.tf_record) is deprecated and will be removed in a future version.
Instructions for updating:
Use eager execution and: 
`tf.data.TFRecordDataset(path)`
2023-09-28 08:51:40,451 start search
2023-09-28 08:51:42,104 Train 000, penalty loss 115.935715
2023-09-28 08:51:42,104 Constraint: 1000.000000
2023-09-28 08:51:42,109 TEST ERROR: 0.069, 0.068, 0.074 | VALID ERROR: 0.062, 0.065, 0.066 | RUNTIME: 1407.327026, 1400.197998, 1410.697021 | PARAMS: 4863626, 4863626, 4863626
2023-09-28 08:51:49,465 Train 010, penalty loss 98.600403
2023-09-28 08:51:49,466 Constraint: 223.478449
2023-09-28 08:51:49,468 TEST ERROR: 0.067, 0.074, 0.065 | VALID ERROR: 0.056, 0.070, 0.060 | RUNTIME: 1835.463989, 1836.457031, 1838.633057 | PARAMS: 12962698, 12962698, 12962698
2023-09-28 08:51:56,760 Train 020, penalty loss 86.338776
2023-09-28 08:51:56,761 Constraint: 186.079896
2023-09-28 08:51:56,763 TEST ERROR: 0.082, 0.084, 0.091 | VALID ERROR: 0.075, 0.078, 0.084 | RUNTIME: 1195.481934, 1195.366943, 1196.814941 | PARAMS: 3905290, 3905290, 3905290
2023-09-28 08:52:04,081 Train 030, penalty loss 121.251663
2023-09-28 08:52:04,082 Constraint: 183.214179
2023-09-28 08:52:04,084 TEST ERROR: 0.071, 0.070, 0.074 | VALID ERROR: 0.070, 0.067, 0.066 | RUNTIME: 1183.938965, 1188.004883, 1186.639038 | PARAMS: 5793546, 5793546, 5793546
2023-09-28 08:52:10,880 final evaluation
2023-09-28 08:52:10,884 TEST ERROR: 0.067, 0.063, 0.065 | VALID ERROR: 0.060, 0.061, 0.057 | RUNTIME: 1605.548096, 1604.724976, 1610.333008 | PARAMS: 6928010, 6928010, 6928010
2023-09-28 09:04:21,877 gpu device = 0
2023-09-28 09:04:21,877 args = Namespace(adaptive=True, batch_size=64, constraint=1000, cutout=False, data='./data', gpu=0, gumbel=True, init_alphas=0, init_channels=16, layers=9, nasbench_data='nasbench_full.tfrecord', output_weights=True, penalty=1, rand_data=False, rand_label=False, report_freq=10, save='search_NASI/nasbench-S0', search_space='2', seed=0, steps=40)
2023-09-28 09:04:24,201 param size = 1.101402MB
2023-09-28 09:04:25,169 loading data from nasbench
2023-09-28 09:04:25,170 From /home/xxxx/NAS-NGE/nasbench/api.py:146: tf_record_iterator (from tensorflow.python.lib.io.tf_record) is deprecated and will be removed in a future version.
Instructions for updating:
Use eager execution and: 
`tf.data.TFRecordDataset(path)`
2023-09-28 09:06:36,648 start search
2023-09-28 09:06:38,626 Train 000, penalty loss 355.398163
2023-09-28 09:06:38,627 Constraint: 1000.000000
2023-09-28 09:06:38,631 TEST ERROR: 0.138, 0.133, 0.145 | VALID ERROR: 0.131, 0.133, 0.140 | RUNTIME: 796.924011, 796.505981, 795.083008 | PARAMS: 826657, 826657, 826657
2023-09-28 09:06:46,006 Train 010, penalty loss 224.258728
2023-09-28 09:06:46,007 Constraint: 281.946631
2023-09-28 09:06:46,009 TEST ERROR: 0.182, 0.179, 0.184 | VALID ERROR: 0.177, 0.181, 0.183 | RUNTIME: 903.421021, 901.928955, 901.460999 | PARAMS: 1232016, 1232016, 1232016
2023-09-28 09:06:53,393 Train 020, penalty loss 92.969788
2023-09-28 09:06:53,393 Constraint: 246.793949
2023-09-28 09:06:53,395 TEST ERROR: 0.182, 0.182, 0.179 | VALID ERROR: 0.178, 0.177, 0.179 | RUNTIME: 897.072021, 898.962036, 896.888977 | PARAMS: 1232016, 1232016, 1232016
2023-09-28 09:07:00,904 Train 030, penalty loss 131.575516
2023-09-28 09:07:00,905 Constraint: 191.007231
2023-09-28 09:07:00,908 TEST ERROR: 0.068, 0.070, 0.073 | VALID ERROR: 0.065, 0.067, 0.064 | RUNTIME: 1265.994995, 1263.658936, 1262.572998 | PARAMS: 3180465, 3180465, 3180465
2023-09-28 09:07:07,872 final evaluation
2023-09-28 09:07:07,876 TEST ERROR: 0.068, 0.070, 0.073 | VALID ERROR: 0.065, 0.067, 0.064 | RUNTIME: 1265.994995, 1263.658936, 1262.572998 | PARAMS: 3180465, 3180465, 3180465
2023-09-28 09:19:30,454 gpu device = 0
2023-09-28 09:19:30,454 args = Namespace(adaptive=True, batch_size=64, constraint=1000, cutout=False, data='./data', gpu=0, gumbel=True, init_alphas=0, init_channels=16, layers=9, nasbench_data='nasbench_full.tfrecord', output_weights=True, penalty=1, rand_data=False, rand_label=False, report_freq=10, save='search_NASI/nasbench-S0', search_space='3', seed=0, steps=40)
2023-09-28 09:19:32,743 param size = 1.509594MB
2023-09-28 09:19:33,733 loading data from nasbench
2023-09-28 09:19:33,734 From /home/xxxx/NAS-NGE/nasbench/api.py:146: tf_record_iterator (from tensorflow.python.lib.io.tf_record) is deprecated and will be removed in a future version.
Instructions for updating:
Use eager execution and: 
`tf.data.TFRecordDataset(path)`
2023-09-28 09:21:47,965 start search
2023-09-28 09:21:49,774 Train 000, penalty loss 1000.000000
2023-09-28 09:21:49,775 Constraint: 1000.000000
2023-09-28 09:21:49,778 TEST ERROR: 0.161, 0.173, 0.164 | VALID ERROR: 0.151, 0.169, 0.159 | RUNTIME: 1187.301025, 1186.814941, 1186.885986 | PARAMS: 445706, 445706, 445706
2023-09-28 09:21:59,134 Train 010, penalty loss 187.596680
2023-09-28 09:21:59,135 Constraint: 354.655289
2023-09-28 09:21:59,137 TEST ERROR: 0.065, 0.067, 0.066 | VALID ERROR: 0.062, 0.061, 0.063 | RUNTIME: 1145.423096, 1140.667969, 1141.523926 | PARAMS: 5793546, 5793546, 5793546
2023-09-28 09:22:08,435 Train 020, penalty loss 248.557419
2023-09-28 09:22:08,436 Constraint: 476.286544
2023-09-28 09:22:08,438 TEST ERROR: 0.182, 0.189, 0.186 | VALID ERROR: 0.186, 0.184, 0.184 | RUNTIME: 771.851013, 771.875977, 773.963989 | PARAMS: 1664778, 1664778, 1664778
2023-09-28 09:22:17,768 Train 030, penalty loss 32.635635
2023-09-28 09:22:17,769 Constraint: 388.804664
2023-09-28 09:22:17,771 TEST ERROR: 0.182, 0.189, 0.186 | VALID ERROR: 0.186, 0.184, 0.184 | RUNTIME: 771.851013, 771.875977, 773.963989 | PARAMS: 1664778, 1664778, 1664778
2023-09-28 09:22:26,339 final evaluation
2023-09-28 09:22:26,344 TEST ERROR: 0.073, 0.070, 0.073 | VALID ERROR: 0.066, 0.069, 0.069 | RUNTIME: 964.230957, 963.804993, 968.712036 | PARAMS: 3729162, 3729162, 3729162
