2023-09-28 08:16:27,077 gpu device = 0
2023-09-28 08:16:27,077 args = Namespace(adaptive=True, batch_size=64, constraint=1000, cutout=False, data='./data', gpu=0, gumbel=True, init_alphas=0, init_channels=16, layers=9, nasbench_data='nasbench_full.tfrecord', output_weights=True, penalty=1, rand_data=False, rand_label=False, report_freq=10, save='search_NAS-NOM/nasbench-S4', search_space='1', seed=4, steps=20)
2023-09-28 08:16:29,328 param size = 1.101402MB
2023-09-28 08:16:30,478 loading data from nasbench
2023-09-28 08:16:30,479 From /home/xxxx/NAS-NGE/nasbench/api.py:146: tf_record_iterator (from tensorflow.python.lib.io.tf_record) is deprecated and will be removed in a future version.
Instructions for updating:
Use eager execution and: 
`tf.data.TFRecordDataset(path)`
2023-09-28 08:18:43,079 start search
2023-09-28 08:18:45,309 Train 000, penalty loss -2.323267
2023-09-28 08:18:45,309 Constraint: 1000.000000
2023-09-28 08:18:45,313 TEST ERROR: 0.116, 0.110, 0.111 | VALID ERROR: 0.117, 0.107, 0.105 | RUNTIME: 944.174988, 945.511963, 946.104980 | PARAMS: 1756298, 1756298, 1756298
2023-09-28 08:18:57,360 Train 010, penalty loss -2.376042
2023-09-28 08:18:57,361 Constraint: 221.665436
2023-09-28 08:18:57,362 TEST ERROR: 0.098, 0.097, 0.093 | VALID ERROR: 0.094, 0.092, 0.085 | RUNTIME: 2157.330078, 2156.570068, 2156.972168 | PARAMS: 6616458, 6616458, 6616458
2023-09-28 08:19:08,269 final evaluation
2023-09-28 08:19:08,272 TEST ERROR: 0.094, 0.094, 0.102 | VALID ERROR: 0.091, 0.088, 0.094 | RUNTIME: 1399.969971, 1398.189941, 1397.876953 | PARAMS: 3667594, 3667594, 3667594
2023-09-28 08:30:52,514 gpu device = 0
2023-09-28 08:30:52,514 args = Namespace(adaptive=True, batch_size=64, constraint=1000, cutout=False, data='./data', gpu=0, gumbel=True, init_alphas=0, init_channels=16, layers=9, nasbench_data='nasbench_full.tfrecord', output_weights=True, penalty=1, rand_data=False, rand_label=False, report_freq=10, save='search_NAS-NOM/nasbench-S4', search_space='2', seed=4, steps=20)
2023-09-28 08:30:54,787 param size = 1.101402MB
2023-09-28 08:30:55,955 loading data from nasbench
2023-09-28 08:30:55,955 From /home/xxxx/NAS-NGE/nasbench/api.py:146: tf_record_iterator (from tensorflow.python.lib.io.tf_record) is deprecated and will be removed in a future version.
Instructions for updating:
Use eager execution and: 
`tf.data.TFRecordDataset(path)`
2023-09-28 08:33:12,163 start search
2023-09-28 08:33:14,526 Train 000, penalty loss -1.891042
2023-09-28 08:33:14,526 Constraint: 1000.000000
2023-09-28 08:33:14,529 TEST ERROR: 0.089, 0.108, 0.084 | VALID ERROR: 0.077, 0.102, 0.078 | RUNTIME: 1422.842041, 1424.334961, 1423.543945 | PARAMS: 3996090, 3996090, 3996090
2023-09-28 08:33:26,542 Train 010, penalty loss -1.839752
2023-09-28 08:33:26,543 Constraint: 225.800488
2023-09-28 08:33:26,545 TEST ERROR: 0.086, 0.087, 0.093 | VALID ERROR: 0.081, 0.085, 0.088 | RUNTIME: 1326.563965, 1328.799072, 1327.586914 | PARAMS: 2948277, 2948277, 2948277
2023-09-28 08:33:37,491 final evaluation
2023-09-28 08:33:37,493 TEST ERROR: 0.114, 0.108, 0.112 | VALID ERROR: 0.110, 0.104, 0.105 | RUNTIME: 1036.343018, 1040.084961, 1039.770996 | PARAMS: 2378295, 2378295, 2378295
2023-09-28 08:45:58,413 gpu device = 0
2023-09-28 08:45:58,413 args = Namespace(adaptive=True, batch_size=64, constraint=1000, cutout=False, data='./data', gpu=0, gumbel=True, init_alphas=0, init_channels=16, layers=9, nasbench_data='nasbench_full.tfrecord', output_weights=True, penalty=1, rand_data=False, rand_label=False, report_freq=10, save='search_NAS-NOM/nasbench-S4', search_space='3', seed=4, steps=20)
2023-09-28 08:46:00,692 param size = 1.509594MB
2023-09-28 08:46:01,899 loading data from nasbench
2023-09-28 08:46:01,899 From /home/xxxx/NAS-NGE/nasbench/api.py:146: tf_record_iterator (from tensorflow.python.lib.io.tf_record) is deprecated and will be removed in a future version.
Instructions for updating:
Use eager execution and: 
`tf.data.TFRecordDataset(path)`
2023-09-28 08:48:18,788 start search
2023-09-28 08:48:21,288 Train 000, penalty loss -1.673797
2023-09-28 08:48:21,288 Constraint: 1000.000000
2023-09-28 08:48:21,293 TEST ERROR: 0.073, 0.076, 0.082 | VALID ERROR: 0.078, 0.072, 0.074 | RUNTIME: 4013.920898, 4013.760010, 4016.384033 | PARAMS: 31389066, 31389066, 31389066
2023-09-28 08:48:36,470 Train 010, penalty loss -1.997029
2023-09-28 08:48:36,473 Constraint: 354.917491
2023-09-28 08:48:36,475 TEST ERROR: 0.068, 0.067, 0.067 | VALID ERROR: 0.062, 0.062, 0.059 | RUNTIME: 1386.105957, 1387.382080, 1391.302002 | PARAMS: 11051402, 11051402, 11051402
2023-09-28 08:48:51,030 final evaluation
2023-09-28 08:48:51,032 TEST ERROR: 0.068, 0.067, 0.067 | VALID ERROR: 0.062, 0.062, 0.059 | RUNTIME: 1386.105957, 1387.382080, 1391.302002 | PARAMS: 11051402, 11051402, 11051402
