2023-09-28 08:13:31,561 gpu device = 0
2023-09-28 08:13:31,561 args = Namespace(adaptive=True, batch_size=64, constraint=1000, cutout=False, data='./data', gpu=0, gumbel=True, init_alphas=0, init_channels=16, layers=9, nasbench_data='nasbench_full.tfrecord', output_weights=True, penalty=1, rand_data=False, rand_label=False, report_freq=10, save='search_NAS-NOM/nasbench-S3', search_space='1', seed=3, steps=20)
2023-09-28 08:13:33,883 param size = 1.101402MB
2023-09-28 08:13:35,065 loading data from nasbench
2023-09-28 08:13:35,066 From /home/xxxx/NAS-NGE/nasbench/api.py:146: tf_record_iterator (from tensorflow.python.lib.io.tf_record) is deprecated and will be removed in a future version.
Instructions for updating:
Use eager execution and: 
`tf.data.TFRecordDataset(path)`
2023-09-28 08:15:49,783 start search
2023-09-28 08:15:52,006 Train 000, penalty loss -2.323672
2023-09-28 08:15:52,006 Constraint: 1000.000000
2023-09-28 08:15:52,010 TEST ERROR: 0.080, 0.089, 0.083 | VALID ERROR: 0.075, 0.081, 0.078 | RUNTIME: 907.046021, 905.291992, 905.932007 | PARAMS: 3207690, 3207690, 3207690
2023-09-28 08:16:04,067 Train 010, penalty loss -1.775951
2023-09-28 08:16:04,068 Constraint: 190.128725
2023-09-28 08:16:04,069 TEST ERROR: 0.080, 0.089, 0.083 | VALID ERROR: 0.075, 0.081, 0.078 | RUNTIME: 907.046021, 905.291992, 905.932007 | PARAMS: 3207690, 3207690, 3207690
2023-09-28 08:16:15,630 final evaluation
2023-09-28 08:16:15,636 TEST ERROR: 0.086, 0.080, 0.087 | VALID ERROR: 0.076, 0.076, 0.076 | RUNTIME: 1389.230957, 1390.059082, 1391.450928 | PARAMS: 5969674, 5969674, 5969674
2023-09-28 08:27:58,603 gpu device = 0
2023-09-28 08:27:58,603 args = Namespace(adaptive=True, batch_size=64, constraint=1000, cutout=False, data='./data', gpu=0, gumbel=True, init_alphas=0, init_channels=16, layers=9, nasbench_data='nasbench_full.tfrecord', output_weights=True, penalty=1, rand_data=False, rand_label=False, report_freq=10, save='search_NAS-NOM/nasbench-S3', search_space='2', seed=3, steps=20)
2023-09-28 08:28:00,870 param size = 1.101402MB
2023-09-28 08:28:02,015 loading data from nasbench
2023-09-28 08:28:02,015 From /home/xxxx/NAS-NGE/nasbench/api.py:146: tf_record_iterator (from tensorflow.python.lib.io.tf_record) is deprecated and will be removed in a future version.
Instructions for updating:
Use eager execution and: 
`tf.data.TFRecordDataset(path)`
2023-09-28 08:30:14,640 start search
2023-09-28 08:30:16,936 Train 000, penalty loss -1.603396
2023-09-28 08:30:16,937 Constraint: 1000.000000
2023-09-28 08:30:16,941 TEST ERROR: 0.078, 0.075, 0.076 | VALID ERROR: 0.070, 0.069, 0.067 | RUNTIME: 1480.624023, 1479.674072, 1483.460938 | PARAMS: 4166026, 4166026, 4166026
2023-09-28 08:30:29,567 Train 010, penalty loss -1.664304
2023-09-28 08:30:29,569 Constraint: 412.948005
2023-09-28 08:30:29,572 TEST ERROR: 0.066, 0.073, 0.074 | VALID ERROR: 0.063, 0.064, 0.064 | RUNTIME: 1650.418945, 1648.706055, 1651.873047 | PARAMS: 4602890, 4602890, 4602890
2023-09-28 08:30:41,178 final evaluation
2023-09-28 08:30:41,181 TEST ERROR: 0.080, 0.076, 0.081 | VALID ERROR: 0.079, 0.072, 0.075 | RUNTIME: 1166.194092, 1160.416016, 1161.217041 | PARAMS: 2155680, 2155680, 2155680
2023-09-28 08:42:57,962 gpu device = 0
2023-09-28 08:42:57,962 args = Namespace(adaptive=True, batch_size=64, constraint=1000, cutout=False, data='./data', gpu=0, gumbel=True, init_alphas=0, init_channels=16, layers=9, nasbench_data='nasbench_full.tfrecord', output_weights=True, penalty=1, rand_data=False, rand_label=False, report_freq=10, save='search_NAS-NOM/nasbench-S3', search_space='3', seed=3, steps=20)
2023-09-28 08:43:00,272 param size = 1.509594MB
2023-09-28 08:43:01,495 loading data from nasbench
2023-09-28 08:43:01,496 From /home/xxxx/NAS-NGE/nasbench/api.py:146: tf_record_iterator (from tensorflow.python.lib.io.tf_record) is deprecated and will be removed in a future version.
Instructions for updating:
Use eager execution and: 
`tf.data.TFRecordDataset(path)`
2023-09-28 08:45:14,099 start search
2023-09-28 08:45:16,729 Train 000, penalty loss -1.658171
2023-09-28 08:45:16,730 Constraint: 1000.000000
2023-09-28 08:45:16,735 TEST ERROR: 0.090, 0.087, 0.094 | VALID ERROR: 0.084, 0.081, 0.084 | RUNTIME: 1393.158936, 1394.573975, 1397.760986 | PARAMS: 5532810, 5532810, 5532810
2023-09-28 08:45:32,844 Train 010, penalty loss -2.037698
2023-09-28 08:45:32,847 Constraint: 740.335905
2023-09-28 08:45:32,850 TEST ERROR: 0.074, 0.079, 0.073 | VALID ERROR: 0.066, 0.070, 0.070 | RUNTIME: 1818.725952, 1819.086914, 1821.356934 | PARAMS: 13126538, 13126538, 13126538
2023-09-28 08:45:46,973 final evaluation
2023-09-28 08:45:46,975 TEST ERROR: 0.068, 0.067, 0.067 | VALID ERROR: 0.062, 0.062, 0.059 | RUNTIME: 1386.105957, 1387.382080, 1391.302002 | PARAMS: 11051402, 11051402, 11051402
