2023-09-28 08:55:19,947 gpu device = 0
2023-09-28 08:55:19,947 args = Namespace(adaptive=True, batch_size=64, constraint=1000, cutout=False, data='./data', gpu=0, gumbel=True, init_alphas=0, init_channels=16, layers=9, nasbench_data='nasbench_full.tfrecord', output_weights=True, penalty=1, rand_data=False, rand_label=False, report_freq=10, save='search_NASI/nasbench-S2', search_space='1', seed=2, steps=40)
2023-09-28 08:55:22,226 param size = 1.101402MB
2023-09-28 08:55:23,187 loading data from nasbench
2023-09-28 08:55:23,188 From /home/xxxx/NAS-NGE/nasbench/api.py:146: tf_record_iterator (from tensorflow.python.lib.io.tf_record) is deprecated and will be removed in a future version.
Instructions for updating:
Use eager execution and: 
`tf.data.TFRecordDataset(path)`
2023-09-28 08:57:34,325 start search
2023-09-28 08:57:35,908 Train 000, penalty loss 34.348000
2023-09-28 08:57:35,909 Constraint: 1000.000000
2023-09-28 08:57:35,914 TEST ERROR: 0.121, 0.116, 0.121 | VALID ERROR: 0.113, 0.115, 0.118 | RUNTIME: 1245.536987, 1248.344971, 1246.918945 | PARAMS: 1840906, 1840906, 1840906
2023-09-28 08:57:43,315 Train 010, penalty loss 260.554626
2023-09-28 08:57:43,316 Constraint: 260.554630
2023-09-28 08:57:43,320 TEST ERROR: 0.071, 0.071, 0.067 | VALID ERROR: 0.061, 0.064, 0.064 | RUNTIME: 1413.979980, 1413.651978, 1417.869019 | PARAMS: 4863626, 4863626, 4863626
2023-09-28 08:57:50,678 Train 020, penalty loss 48.930954
2023-09-28 08:57:50,678 Constraint: 288.025451
2023-09-28 08:57:50,680 TEST ERROR: 0.069, 0.071, 0.070 | VALID ERROR: 0.065, 0.065, 0.066 | RUNTIME: 1117.463989, 1116.784912, 1118.291016 | PARAMS: 4166026, 4166026, 4166026
2023-09-28 08:57:58,045 Train 030, penalty loss 44.547699
2023-09-28 08:57:58,046 Constraint: 282.917513
2023-09-28 08:57:58,048 TEST ERROR: 0.069, 0.071, 0.070 | VALID ERROR: 0.065, 0.065, 0.066 | RUNTIME: 1117.463989, 1116.784912, 1118.291016 | PARAMS: 4166026, 4166026, 4166026
2023-09-28 08:58:04,929 final evaluation
2023-09-28 08:58:04,933 TEST ERROR: 0.069, 0.071, 0.070 | VALID ERROR: 0.065, 0.065, 0.066 | RUNTIME: 1117.463989, 1116.784912, 1118.291016 | PARAMS: 4166026, 4166026, 4166026
2023-09-28 09:10:26,909 gpu device = 0
2023-09-28 09:10:26,909 args = Namespace(adaptive=True, batch_size=64, constraint=1000, cutout=False, data='./data', gpu=0, gumbel=True, init_alphas=0, init_channels=16, layers=9, nasbench_data='nasbench_full.tfrecord', output_weights=True, penalty=1, rand_data=False, rand_label=False, report_freq=10, save='search_NASI/nasbench-S2', search_space='2', seed=2, steps=40)
2023-09-28 09:10:29,191 param size = 1.101402MB
2023-09-28 09:10:30,178 loading data from nasbench
2023-09-28 09:10:30,179 From /home/xxxx/NAS-NGE/nasbench/api.py:146: tf_record_iterator (from tensorflow.python.lib.io.tf_record) is deprecated and will be removed in a future version.
Instructions for updating:
Use eager execution and: 
`tf.data.TFRecordDataset(path)`
2023-09-28 09:12:39,821 start search
2023-09-28 09:12:41,441 Train 000, penalty loss 883.469604
2023-09-28 09:12:41,441 Constraint: 1000.000000
2023-09-28 09:12:41,446 TEST ERROR: 0.083, 0.081, 0.085 | VALID ERROR: 0.078, 0.075, 0.079 | RUNTIME: 983.755005, 982.595947, 980.973022 | PARAMS: 1969346, 1969346, 1969346
2023-09-28 09:12:48,838 Train 010, penalty loss 178.130707
2023-09-28 09:12:48,839 Constraint: 673.917860
2023-09-28 09:12:48,842 TEST ERROR: 0.082, 0.078, 0.080 | VALID ERROR: 0.077, 0.073, 0.073 | RUNTIME: 1174.456055, 1179.941895, 1179.274048 | PARAMS: 2155707, 2155707, 2155707
2023-09-28 09:12:56,243 Train 020, penalty loss 469.163574
2023-09-28 09:12:56,243 Constraint: 469.163760
2023-09-28 09:12:56,246 TEST ERROR: 0.079, 0.080, 0.084 | VALID ERROR: 0.071, 0.075, 0.076 | RUNTIME: 1280.557983, 1283.045898, 1279.018066 | PARAMS: 3062069, 3062069, 3062069
2023-09-28 09:13:03,712 Train 030, penalty loss 90.282021
2023-09-28 09:13:03,713 Constraint: 578.187352
2023-09-28 09:13:03,715 TEST ERROR: 0.079, 0.080, 0.084 | VALID ERROR: 0.071, 0.075, 0.076 | RUNTIME: 1280.557983, 1283.045898, 1279.018066 | PARAMS: 3062069, 3062069, 3062069
2023-09-28 09:13:10,654 final evaluation
2023-09-28 09:13:10,659 TEST ERROR: 0.079, 0.080, 0.084 | VALID ERROR: 0.071, 0.075, 0.076 | RUNTIME: 1280.557983, 1283.045898, 1279.018066 | PARAMS: 3062069, 3062069, 3062069
2023-09-28 09:37:13,328 gpu device = 0
2023-09-28 09:37:13,328 args = Namespace(adaptive=True, batch_size=64, constraint=1000, cutout=False, data='./data', gpu=0, gumbel=True, init_alphas=0, init_channels=16, layers=9, nasbench_data='nasbench_full.tfrecord', output_weights=True, penalty=1, rand_data=False, rand_label=False, report_freq=10, save='search_NASI/nasbench-S2', search_space='3', seed=2, steps=40)
2023-09-28 09:37:15,666 param size = 1.509594MB
2023-09-28 09:37:16,621 loading data from nasbench
2023-09-28 09:37:16,621 From /home/xxxx/NAS-NGE/nasbench/api.py:146: tf_record_iterator (from tensorflow.python.lib.io.tf_record) is deprecated and will be removed in a future version.
Instructions for updating:
Use eager execution and: 
`tf.data.TFRecordDataset(path)`
2023-09-28 09:39:29,667 start search
2023-09-28 09:39:31,508 Train 000, penalty loss 376.273407
2023-09-28 09:39:31,509 Constraint: 1000.000000
2023-09-28 09:39:31,512 TEST ERROR: 0.164, 0.160, 0.164 | VALID ERROR: 0.166, 0.159, 0.167 | RUNTIME: 734.977051, 732.700012, 733.009033 | PARAMS: 2793866, 2793866, 2793866
2023-09-28 09:39:40,754 Train 010, penalty loss 31.130207
2023-09-28 09:39:40,755 Constraint: 544.815408
2023-09-28 09:39:40,756 TEST ERROR: 0.082, 0.078, 0.081 | VALID ERROR: 0.073, 0.077, 0.073 | RUNTIME: 666.401978, 667.278015, 669.222046 | PARAMS: 3031562, 3031562, 3031562
2023-09-28 09:39:49,977 Train 020, penalty loss 315.202240
2023-09-28 09:39:49,978 Constraint: 450.989130
2023-09-28 09:39:49,980 TEST ERROR: 0.066, 0.068, 0.065 | VALID ERROR: 0.063, 0.059, 0.061 | RUNTIME: 1007.158997, 1007.922974, 1008.242981 | PARAMS: 5532810, 5532810, 5532810
2023-09-28 09:39:59,342 Train 030, penalty loss 235.708084
2023-09-28 09:39:59,343 Constraint: 363.008080
2023-09-28 09:39:59,345 TEST ERROR: 0.076, 0.074, 0.072 | VALID ERROR: 0.073, 0.067, 0.066 | RUNTIME: 1157.626953, 1156.379028, 1157.510986 | PARAMS: 7421066, 7421066, 7421066
2023-09-28 09:40:07,823 final evaluation
2023-09-28 09:40:07,827 TEST ERROR: 0.082, 0.078, 0.081 | VALID ERROR: 0.073, 0.077, 0.073 | RUNTIME: 666.401978, 667.278015, 669.222046 | PARAMS: 3031562, 3031562, 3031562
