2023-09-28 08:58:16,221 gpu device = 0
2023-09-28 08:58:16,221 args = Namespace(adaptive=True, batch_size=64, constraint=1000, cutout=False, data='./data', gpu=0, gumbel=True, init_alphas=0, init_channels=16, layers=9, nasbench_data='nasbench_full.tfrecord', output_weights=True, penalty=1, rand_data=False, rand_label=False, report_freq=10, save='search_NASI/nasbench-S3', search_space='1', seed=3, steps=40)
2023-09-28 08:58:18,466 param size = 1.101402MB
2023-09-28 08:58:19,409 loading data from nasbench
2023-09-28 08:58:19,410 From /home/xxxx/NAS-NGE/nasbench/api.py:146: tf_record_iterator (from tensorflow.python.lib.io.tf_record) is deprecated and will be removed in a future version.
Instructions for updating:
Use eager execution and: 
`tf.data.TFRecordDataset(path)`
2023-09-28 09:00:33,162 start search
2023-09-28 09:00:34,825 Train 000, penalty loss 46.348907
2023-09-28 09:00:34,826 Constraint: 1000.000000
2023-09-28 09:00:34,828 TEST ERROR: 0.089, 0.094, 0.090 | VALID ERROR: 0.084, 0.087, 0.084 | RUNTIME: 931.312988, 931.320007, 928.857056 | PARAMS: 3207690, 3207690, 3207690
2023-09-28 09:00:42,353 Train 010, penalty loss 19.974142
2023-09-28 09:00:42,354 Constraint: 259.855038
2023-09-28 09:00:42,356 TEST ERROR: 0.067, 0.065, 0.065 | VALID ERROR: 0.061, 0.060, 0.061 | RUNTIME: 1313.564941, 1312.516968, 1316.986084 | PARAMS: 6230410, 6230410, 6230410
2023-09-28 09:00:49,818 Train 020, penalty loss 88.396805
2023-09-28 09:00:49,818 Constraint: 208.494719
2023-09-28 09:00:49,821 TEST ERROR: 0.067, 0.065, 0.065 | VALID ERROR: 0.061, 0.060, 0.061 | RUNTIME: 1313.564941, 1312.516968, 1316.986084 | PARAMS: 6230410, 6230410, 6230410
2023-09-28 09:00:57,313 Train 030, penalty loss 152.854416
2023-09-28 09:00:57,314 Constraint: 195.004192
2023-09-28 09:00:57,317 TEST ERROR: 0.065, 0.064, 0.068 | VALID ERROR: 0.059, 0.061, 0.059 | RUNTIME: 1311.856934, 1314.113037, 1312.753052 | PARAMS: 6230410, 6230410, 6230410
2023-09-28 09:01:03,823 final evaluation
2023-09-28 09:01:03,825 TEST ERROR: 0.074, 0.075, 0.072 | VALID ERROR: 0.066, 0.067, 0.065 | RUNTIME: 1127.636963, 1129.404053, 1128.720947 | PARAMS: 4166026, 4166026, 4166026
2023-09-28 09:13:24,106 gpu device = 0
2023-09-28 09:13:24,106 args = Namespace(adaptive=True, batch_size=64, constraint=1000, cutout=False, data='./data', gpu=0, gumbel=True, init_alphas=0, init_channels=16, layers=9, nasbench_data='nasbench_full.tfrecord', output_weights=True, penalty=1, rand_data=False, rand_label=False, report_freq=10, save='search_NASI/nasbench-S3', search_space='2', seed=3, steps=40)
2023-09-28 09:13:26,371 param size = 1.101402MB
2023-09-28 09:13:27,336 loading data from nasbench
2023-09-28 09:13:27,336 From /home/xxxx/NAS-NGE/nasbench/api.py:146: tf_record_iterator (from tensorflow.python.lib.io.tf_record) is deprecated and will be removed in a future version.
Instructions for updating:
Use eager execution and: 
`tf.data.TFRecordDataset(path)`
2023-09-28 09:15:41,752 start search
2023-09-28 09:15:43,359 Train 000, penalty loss 95.985237
2023-09-28 09:15:43,360 Constraint: 1000.000000
2023-09-28 09:15:43,364 TEST ERROR: 0.108, 0.102, 0.099 | VALID ERROR: 0.102, 0.096, 0.098 | RUNTIME: 1253.489990, 1253.092041, 1253.230957 | PARAMS: 1907355, 1907355, 1907355
2023-09-28 09:15:50,791 Train 010, penalty loss 199.233643
2023-09-28 09:15:50,792 Constraint: 199.233687
2023-09-28 09:15:50,795 TEST ERROR: 0.090, 0.084, 0.086 | VALID ERROR: 0.079, 0.079, 0.077 | RUNTIME: 1270.458008, 1272.096924, 1274.043945 | PARAMS: 3062588, 3062588, 3062588
2023-09-28 09:15:58,190 Train 020, penalty loss 213.069992
2023-09-28 09:15:58,190 Constraint: 268.790404
2023-09-28 09:15:58,192 TEST ERROR: 0.069, 0.070, 0.074 | VALID ERROR: 0.059, 0.060, 0.065 | RUNTIME: 2446.316895, 2446.762939, 2447.085938 | PARAMS: 8992394, 8992394, 8992394
2023-09-28 09:16:05,587 Train 030, penalty loss 165.097549
2023-09-28 09:16:05,588 Constraint: 250.305789
2023-09-28 09:16:05,592 TEST ERROR: 0.069, 0.070, 0.069 | VALID ERROR: 0.065, 0.063, 0.060 | RUNTIME: 1364.130005, 1358.171997, 1366.962891 | PARAMS: 4098887, 4098887, 4098887
2023-09-28 09:16:12,449 final evaluation
2023-09-28 09:16:12,453 TEST ERROR: 0.069, 0.070, 0.069 | VALID ERROR: 0.065, 0.063, 0.060 | RUNTIME: 1364.130005, 1358.171997, 1366.962891 | PARAMS: 4098887, 4098887, 4098887
2023-09-28 09:40:19,321 gpu device = 0
2023-09-28 09:40:19,321 args = Namespace(adaptive=True, batch_size=64, constraint=1000, cutout=False, data='./data', gpu=0, gumbel=True, init_alphas=0, init_channels=16, layers=9, nasbench_data='nasbench_full.tfrecord', output_weights=True, penalty=1, rand_data=False, rand_label=False, report_freq=10, save='search_NASI/nasbench-S3', search_space='3', seed=3, steps=40)
2023-09-28 09:40:21,647 param size = 1.509594MB
2023-09-28 09:40:22,614 loading data from nasbench
2023-09-28 09:40:22,614 From /home/xxxx/NAS-NGE/nasbench/api.py:146: tf_record_iterator (from tensorflow.python.lib.io.tf_record) is deprecated and will be removed in a future version.
Instructions for updating:
Use eager execution and: 
`tf.data.TFRecordDataset(path)`
2023-09-28 09:42:35,947 start search
2023-09-28 09:42:37,729 Train 000, penalty loss 20.684420
2023-09-28 09:42:37,729 Constraint: 1000.000000
2023-09-28 09:42:37,732 TEST ERROR: 0.090, 0.087, 0.101 | VALID ERROR: 0.083, 0.085, 0.094 | RUNTIME: 1523.859985, 1525.164062, 1523.071045 | PARAMS: 5793546, 5793546, 5793546
2023-09-28 09:42:46,847 Train 010, penalty loss 157.558945
2023-09-28 09:42:46,848 Constraint: 364.403325
2023-09-28 09:42:46,850 TEST ERROR: 0.067, 0.071, 0.068 | VALID ERROR: 0.063, 0.063, 0.062 | RUNTIME: 818.963989, 819.830994, 821.432983 | PARAMS: 3468426, 3468426, 3468426
2023-09-28 09:42:56,075 Train 020, penalty loss 55.679497
2023-09-28 09:42:56,076 Constraint: 452.863241
2023-09-28 09:42:56,078 TEST ERROR: 0.068, 0.066, 0.064 | VALID ERROR: 0.062, 0.059, 0.057 | RUNTIME: 1685.249023, 1683.821045, 1682.426025 | PARAMS: 8118666, 8118666, 8118666
2023-09-28 09:43:05,186 Train 030, penalty loss 215.041306
2023-09-28 09:43:05,187 Constraint: 474.879929
2023-09-28 09:43:05,189 TEST ERROR: 0.072, 0.067, 0.068 | VALID ERROR: 0.064, 0.062, 0.066 | RUNTIME: 1455.593994, 1459.642090, 1463.385986 | PARAMS: 8118666, 8118666, 8118666
2023-09-28 09:43:13,549 final evaluation
2023-09-28 09:43:13,552 TEST ERROR: 0.073, 0.070, 0.072 | VALID ERROR: 0.064, 0.063, 0.064 | RUNTIME: 1155.697998, 1156.444092, 1155.266113 | PARAMS: 5793546, 5793546, 5793546
