2023-09-28 09:01:15,176 gpu device = 0
2023-09-28 09:01:15,176 args = Namespace(adaptive=True, batch_size=64, constraint=1000, cutout=False, data='./data', gpu=0, gumbel=True, init_alphas=0, init_channels=16, layers=9, nasbench_data='nasbench_full.tfrecord', output_weights=True, penalty=1, rand_data=False, rand_label=False, report_freq=10, save='search_NASI/nasbench-S4', search_space='1', seed=4, steps=40)
2023-09-28 09:01:17,450 param size = 1.101402MB
2023-09-28 09:01:18,402 loading data from nasbench
2023-09-28 09:01:18,403 From /home/xxxx/NAS-NGE/nasbench/api.py:146: tf_record_iterator (from tensorflow.python.lib.io.tf_record) is deprecated and will be removed in a future version.
Instructions for updating:
Use eager execution and: 
`tf.data.TFRecordDataset(path)`
2023-09-28 09:03:31,344 start search
2023-09-28 09:03:33,272 Train 000, penalty loss 71.360092
2023-09-28 09:03:33,273 Constraint: 1000.000000
2023-09-28 09:03:33,276 TEST ERROR: 0.124, 0.121, 0.123 | VALID ERROR: 0.121, 0.115, 0.116 | RUNTIME: 1246.725098, 1252.994995, 1254.093994 | PARAMS: 1580170, 1580170, 1580170
2023-09-28 09:03:40,523 Train 010, penalty loss 319.770020
2023-09-28 09:03:40,524 Constraint: 319.770042
2023-09-28 09:03:40,526 TEST ERROR: 0.108, 0.113, 0.113 | VALID ERROR: 0.106, 0.109, 0.107 | RUNTIME: 1173.348022, 1171.951050, 1173.711914 | PARAMS: 2101642, 2101642, 2101642
2023-09-28 09:03:47,750 Train 020, penalty loss 85.006973
2023-09-28 09:03:47,751 Constraint: 295.342938
2023-09-28 09:03:47,753 TEST ERROR: 0.119, 0.125, 0.129 | VALID ERROR: 0.115, 0.122, 0.117 | RUNTIME: 1272.397949, 1271.929932, 1271.862061 | PARAMS: 2538506, 2538506, 2538506
2023-09-28 09:03:55,020 Train 030, penalty loss 241.988876
2023-09-28 09:03:55,021 Constraint: 241.988872
2023-09-28 09:03:55,023 TEST ERROR: 0.078, 0.069, 0.081 | VALID ERROR: 0.068, 0.068, 0.075 | RUNTIME: 1471.737061, 1480.541992, 1481.311035 | PARAMS: 4602890, 4602890, 4602890
2023-09-28 09:04:01,864 final evaluation
2023-09-28 09:04:01,868 TEST ERROR: 0.211, 0.199, 0.203 | VALID ERROR: 0.220, 0.198, 0.207 | RUNTIME: 1091.645020, 1089.708984, 1089.282959 | PARAMS: 2362378, 2362378, 2362378
2023-09-28 09:16:24,460 gpu device = 0
2023-09-28 09:16:24,460 args = Namespace(adaptive=True, batch_size=64, constraint=1000, cutout=False, data='./data', gpu=0, gumbel=True, init_alphas=0, init_channels=16, layers=9, nasbench_data='nasbench_full.tfrecord', output_weights=True, penalty=1, rand_data=False, rand_label=False, report_freq=10, save='search_NASI/nasbench-S4', search_space='2', seed=4, steps=40)
2023-09-28 09:16:26,734 param size = 1.101402MB
2023-09-28 09:16:27,736 loading data from nasbench
2023-09-28 09:16:27,737 From /home/xxxx/NAS-NGE/nasbench/api.py:146: tf_record_iterator (from tensorflow.python.lib.io.tf_record) is deprecated and will be removed in a future version.
Instructions for updating:
Use eager execution and: 
`tf.data.TFRecordDataset(path)`
2023-09-28 09:18:42,058 start search
2023-09-28 09:18:43,696 Train 000, penalty loss 119.840187
2023-09-28 09:18:43,697 Constraint: 1000.000000
2023-09-28 09:18:43,700 TEST ERROR: 0.098, 0.099, 0.102 | VALID ERROR: 0.095, 0.092, 0.092 | RUNTIME: 1320.498047, 1327.543945, 1325.511963 | PARAMS: 2948277, 2948277, 2948277
2023-09-28 09:18:51,016 Train 010, penalty loss 46.178055
2023-09-28 09:18:51,016 Constraint: 342.488110
2023-09-28 09:18:51,019 TEST ERROR: 0.077, 0.069, 0.077 | VALID ERROR: 0.069, 0.066, 0.070 | RUNTIME: 1113.729004, 1113.700928, 1113.807007 | PARAMS: 2891845, 2891845, 2891845
2023-09-28 09:18:58,374 Train 020, penalty loss 72.166252
2023-09-28 09:18:58,374 Constraint: 212.697623
2023-09-28 09:18:58,377 TEST ERROR: 0.093, 0.091, 0.096 | VALID ERROR: 0.090, 0.085, 0.088 | RUNTIME: 812.499023, 812.552002, 812.458984 | PARAMS: 1691442, 1691442, 1691442
2023-09-28 09:19:05,738 Train 030, penalty loss 40.024643
2023-09-28 09:19:05,739 Constraint: 193.970542
2023-09-28 09:19:05,742 TEST ERROR: 0.079, 0.082, 0.080 | VALID ERROR: 0.073, 0.074, 0.078 | RUNTIME: 955.575012, 954.828979, 956.820984 | PARAMS: 2610483, 2610483, 2610483
2023-09-28 09:19:12,680 final evaluation
2023-09-28 09:19:12,684 TEST ERROR: 0.085, 0.090, 0.093 | VALID ERROR: 0.083, 0.085, 0.087 | RUNTIME: 700.533997, 700.882996, 700.702026 | PARAMS: 1570080, 1570080, 1570080
2023-09-28 09:43:25,050 gpu device = 0
2023-09-28 09:43:25,050 args = Namespace(adaptive=True, batch_size=64, constraint=1000, cutout=False, data='./data', gpu=0, gumbel=True, init_alphas=0, init_channels=16, layers=9, nasbench_data='nasbench_full.tfrecord', output_weights=True, penalty=1, rand_data=False, rand_label=False, report_freq=10, save='search_NASI/nasbench-S4', search_space='3', seed=4, steps=40)
2023-09-28 09:43:27,327 param size = 1.509594MB
2023-09-28 09:43:28,277 loading data from nasbench
2023-09-28 09:43:28,278 From /home/xxxx/NAS-NGE/nasbench/api.py:146: tf_record_iterator (from tensorflow.python.lib.io.tf_record) is deprecated and will be removed in a future version.
Instructions for updating:
Use eager execution and: 
`tf.data.TFRecordDataset(path)`
2023-09-28 09:45:42,905 start search
2023-09-28 09:45:44,767 Train 000, penalty loss 122.553101
2023-09-28 09:45:44,767 Constraint: 1000.000000
2023-09-28 09:45:44,769 TEST ERROR: 0.130, 0.129, 0.129 | VALID ERROR: 0.126, 0.121, 0.121 | RUNTIME: 874.526978, 872.294983, 876.330994 | PARAMS: 967178, 967178, 967178
2023-09-28 09:45:53,813 Train 010, penalty loss 50.885593
2023-09-28 09:45:53,814 Constraint: 397.920171
2023-09-28 09:45:53,815 TEST ERROR: 0.092, 0.103, 0.098 | VALID ERROR: 0.088, 0.094, 0.092 | RUNTIME: 904.540039, 906.692993, 909.825989 | PARAMS: 3553034, 3553034, 3553034
2023-09-28 09:46:02,847 Train 020, penalty loss 201.131821
2023-09-28 09:46:02,847 Constraint: 383.992642
2023-09-28 09:46:02,850 TEST ERROR: 0.076, 0.074, 0.072 | VALID ERROR: 0.070, 0.071, 0.065 | RUNTIME: 1264.806030, 1263.656006, 1263.890991 | PARAMS: 6054282, 6054282, 6054282
2023-09-28 09:46:11,937 Train 030, penalty loss 52.406219
2023-09-28 09:46:11,938 Constraint: 1295.566201
2023-09-28 09:46:11,939 TEST ERROR: 0.181, 0.186, 0.185 | VALID ERROR: 0.180, 0.188, 0.182 | RUNTIME: 660.691040, 658.743042, 660.739014 | PARAMS: 1404042, 1404042, 1404042
2023-09-28 09:46:20,234 final evaluation
2023-09-28 09:46:20,239 TEST ERROR: 0.175, 0.174, 0.175 | VALID ERROR: 0.173, 0.172, 0.174 | RUNTIME: 626.531982, 626.835022, 627.174988 | PARAMS: 1404042, 1404042, 1404042
